Model 



Evolution of Voltage over Time 

Consider a group of interacting populations of neurons. Equation [1] describes the evolution over time of the membrane 
voltages for the ith ensemble. Table [T] explains the remaining variables. 
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Symbol Meaning 

Connections from jth ensemble to ith 
Wj Weight of input for ith ensemble 
u Input 
t Time constant 

Table 1: Meaning of symbols in Equation [T] 

To represent n ensembles, we may combine n versions of Equation [TJ as Equation [5] describes. 
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If the real part of the eigenvalues of M are less than one, then the system will evolve to the voltage that Equation [3] 
describes. 
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Islands of Steady State Behavior 

M need not be symmetric. But, if some block matrices within it are, the corresponding subpopulations can approach 
their own steady state even if the network is still unstable. If, furthermore, the combination of recurrent and feedforward 
input to those subpopulations is a saturating function, then the system's Lyapunov function is bounded and fixed points 
for that subpopulation must exist (Cohen and Grossberg, 1983). 

One reasonable way to create a symmetric weight matrix for M^, the block matrix that describes the fcth ensemble 
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n neurons signals its recognition of any memory pattern, w m , by displaying a voltage vector cv'' 
accomplishes this is: 
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Longer-term Effects on Neural Population Dynamics 

Assume that two additional processes occur as defined by Equations [5] and [51 Both are much slower than Equation 
[21 One modifies W and an even slower one modifies M. 
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Replacing v with z/ooin Equations [5] and [5] yields Equations [7] and [5] Note the appearance of the autocorrelation 
matrices for the stimulus, Q, and network activity, R. 
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Equations [JJ and [5] describe somewhat contrasting behaviors. Equation [7J aligns the correlation structure of the 
network activity with the strength of its recurrent connections. Equation [5] urges the outputs to be decorrelated. A faster 
correlating influence and slower decorrelating one allow oscillations in the correlation of network activity. According to 
this model, interestingly, those oscillations are dependent on input but not directly on the correlation structure of the 
input. 

Remarks on the Structure of the Model 

There is an interesting concordance between R and Equation 21 If R mem = (v mem v mem ), then M oc ^ R mem . This 
further highlights how interrelated Equations [JJ and [5] are. 

Effect of Correlation Structure on the Dynamics of the Feedforward Weights 

If the stimulus is random, that is Q = I, then the feedforward weights, W, stop changing only when K = aR^,. Com- 
bining the definition of K in Equation [3] with the observation that Rqq must haverank 1 we note that such stimuli prevent 
this system from recognizing any pattern that requires a distribution of activities over the network. Moreover, consider- 
ing the rank-nullity theorem and ranks of Q and R, one can see that this result holds for any stimulus autocorrelation 
matrix, Q, that results from the outer product of a vector with itself. 

It is next natural to consider how this system responds to many superimposed stimuli that each have different corre- 
lation structures. That is, consider aQ that results from the sum of i correlation matrices. Each of those autocorrelation 
matrices results from the outer product of the zth activity pattern with itself, as Equation [5] describes. 



If we assume that all the input patterns are pairwise independent, then the rank of Q becomes equal to i, whose 
upper bound we assume to be the number of neurons. This stands in contrast to the result of the previous paragraph. 

Effects of Correlation Structure on the Dynamics of Network Connections 

By studying Equation [5] we can gain some insight into how u and W influence M. If u lies in the nullspace of the 
columns of W, then M approaches the identity matrix. Said another way, when u and W jam each other, M tries to 
span the largest basis it can. 

The contrary effects of 

Nonrandom Constant Stimulus 

Consider any brief nonrandom stimulus such that, Q ^ I but is constant. ThenW only stops changing if the columns 
of Q are in the nullspace of the rows of W. BecauseQ results from the tensor product of a vector with itself, it has rank 1 
and so it may lie in the nullspace of W. 



If a stimulus is presented to the system for a brief period of time, it will only cause sustained activity in the system if 
the activity that it induces is itself a fixed point of the system. That is, for a stimulus, u, and its response, v, Equation 
must hold. 

Extension to Drug Addiction 



Similar response to variable reinforcement and huge rewards. Let the ith subpopulation of Equation [2] in analogy with 
a proposed role for the dopaminergic neurons in ventral tegmental area (VTA) represent the positive expecrted reward 
of a stimulus. Let another population, the jth one, in analogy with the GABAergic neurons in the VTA represent the 
negative expected reward. 
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